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ESTIMATION  oy  chos*- spectra  via  overlapped 
FAST  FOURIER  TRANSFORM  PROCESSING 


TR  4169-S 


iRTHooucrros 

luSi  recent  report  (Ref.  I),  thr  use  of  overlap  •« ' Fourier 

trenefivrm  (FF?)  processing  of  windowed  iiU  fop  v'lnaiicx;  of  R.uto- spectra 
was  thoroughly  investigated.  It  is  now  desired  L..  giiiand  Wteaa  reau i t#  to 
estimation  of  crcrs-n-oetra.  The  iwthcd  of  overlapped  FIT  procasslng  Is 
often  used  for  cross- Bpeetral  end  coherence  estiwaito®  with  gixx!  nwuiti 
(see,  for  exasspic,  Hof.  j here  v*<  wicfe  to  give  analytical  back-up  to  its 
optiamilty. 


HtOBLfirt  JtEFIKITIOl; 

Consider  tliai  stationary  rtiidtv*  prtoesaep  x(t)  and  y(l)  have  fcoen 
observed  far  « time  interval  of  f seconds*  0<4  *T,  Let  the  auto-spectra 
of  the  processes  at  frequency  f be  6*(f)  and  ( f),  respectively,  and 
let  the  (complex'*  cr:^-»pe'*irufci  be  ^(f).  The  method  of  estimating  the 
cross- cpestrua  is  discUas*!  thoroughly  on  pages  2-4  of  Ref.  1,  and  vi ' S 
r.ct  be  repealed  her«{  *?  « reader  is  roferrod  to  that  reference  for  nota- 
tion, related  past  work,  end  qualification/*,.  Ve  let  w(t)  denote  the 
fundamental  data  window,  and  S'  the  shift  of  each  sue  erosive  overlapped 
window,  and  defii.-j 

- w(r*  ^ -(*-0^  (1) 

where  V Is  the  total  number  of  overlapped  segments  fl Ming  into  the  t>»T) 
Interval.  The  estimate  of  the  cross* epoetru»  In'7 

$„<»'•  i JfX.U'Y.’lfi,  ;j) 

? ’ «n 

where 

i;r  : f<#  a-ft.jen)  a,h' 

X, 'i' '•  fff  «>(-.)» 10 y ill 

(The  cent  Inu  u.n  vi*rri»B  dis.’rete  versions  of  O*  are  discussed  cn  page  4 
of  Ref.  1 .) 

The  estimate  *...  5s  a ectepiox  rand  tt  variel  U (lv)  which  it  is  hc-ed 
will  approximate  'he  true  cross- spectrum  f'  for  sufficient  f.  largo  T 
and  pro  par  choice  ,'f  :1,1ft  5 . The  prcbl  <M  is  to  evaluate  the  stabi.it/  of 

the  lv  I !r',  and  r:  • !r:i  a**  the  stabi’lty  by  choice  -f  ever  la?  . A*  'he 
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•Carets  den-  ie  rand- e.  variables,  ar*i  Integral  without.  limits  are  ever 
the  range  f r.  -n-  sere  int*  grand. 
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ea a*  tine,  we  wish  to  Investigate  the  dependence  of  the  stability  oa  the 
fundanentai  paraaeters  such  as  observation  t.£iee  T , desired  frequency 


resolution  ■ft,  spectra  (Sw(f),  Vr!- 


’ } (i 


etc. 


nmurn  solution 

In  Appendix  A , the  mean  of  fV  ^(f)  is  aetemined  to  be 

* Jdf 

where 

and  we  have  assumed,  with  no  ions  of  generality,  that  niw»r- 1. 

The  exact  relation  (4»)  'radicates  that  the  naan  is  equal  to  the  convolu- 
tion of  the  true  apentrun  £ ^{t)  with  a spectral  window  |W)j\  (Cashable 
aspects  of  windows  are  discussed  on  pages  10-18  of  Ref.  J.)  The  approxi- 
aation  (4B)  is  valid  wh-.r  the  frequency  width  B of  spectral  window  iWWf 
is  narrower  than  the  finest  detail  in  tha  true  speetru*  £,,( f) . These 
result#  are  not  restricted  tc  Gaussian  processes,  but  hold  for  ary  station- 
ary process.es  x(l)  and  y(t'J. 


UK) 

(AB) 

(5) 


We  now  define  tfca  *ero-»eait  wasp!  ax 

!«'•  S^IP-  * i,(P-  <M 


This 

true 


tv  jmesures  the  i.iv  i#’. . r.  ,.f  tb*  estlsrat*  of  cross- spec trua  iron  its 
value.  !r  Apt-end i * *■..  the  ft  'lowing  two  relations  arc  demonstrated; 


(7  A? 

(7B) 


where 

h'  t ■ & a»l>w%(b  -t).  (8) 

assumptions  are  r«-julr*’d  frr  th«-  validity  of  (7):  the  processes 

xii)  and  yit)  are  jointly  Gaussian;  the  frequency  f of  Interest  must  be 
greater  than  bandwidth  I*  ?f  window  iV^fi  end  bandwidth  B nust  be  less 


1 
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than  the  narrowest  detail  in  fr,»(f),  fir^f),  and  6~,(f).  (A  case  where  B 
is  greater  than  the  narrowest  detail  is  discussed  later.) 


A measure  of  the  statility  of  a RV  is  afforded  by  its  equivalent 
number  of  degrees  of  freedom  (EDF) ; see  Ref.  3,  p.  22.  For  a complex  2, 

we  extend  the  definition  to 


EDF  * 2 


e[u-  mn 


The  denominator  of  (9)  could  be  interpreted  as  the  variance  of  complex  "RV 
Interpreting  2.  as  £*,(f),  and  using  (4B),  (6),  (7A),  (8),  and  Parseval's 
Theorem,  there  fellows  for  the  EDF  at  frequency  f, 


A 

2, 


epf  = iy,(f)r  k, 


(10) 


where 


and 


(11) 


(12) 


The  quantity  y*(f>  is  the  complex  coherence  at  frequency  f of  processes 
x(t)  and  y(t) . Equation  (10)  indicates  that  the  EDF  at  frequency  f of  RV 
G»(f)  is  given  by  the  product  of  two  factors,  one  frequency-dependent 
solely  on  the  processes’  spectra  (over  which  we  have  no  control^),  and  the 
other  depending  solely  on  the  method  of  processing,  but  being  frequency- 
independent.  Specifically,  depends  on  the  number  of  pieces  ”p  in  the 
average  (2),  the  shift  S of  each  window  in  (l),  and  the  autocorrelation 
Kir)  of  the  window  w(t) . Furthermore,  this  factor  K is  precisely  the 
same  quantity  encountered  in  Ref.  1 as  the  EDF  for  auto-spectral  estima- 
tion. Therefore  all  the  results  of  Ref.  1 on  maximization  of  K by  choice 
of  shift  S are  immediately  brought  to  bear  on  the  present  problem  of 
cross-spectral  estimation.  Thus,  the  optimum  choice  of  overlap  for  cross- 
spectral  estimation  is  identical  to  that  for  auto-spectral  estimation. 


^Linear  filtering  of  x(t)  and/or  y(t),  such  as  pre-whitening,  would 
not  affect  [ (f)  |l  , and  therefore  not  affect  EDF.  A related 

observation  on  this  aspect  is  made  in  Ref.  4,  p.  379- 

#!tMore  generally,  since  all  the  variances  of  the  estimates  in  the  following 
sections  depend  inversely  on  K.  , maximization  of  K is  appropriate, 
regardless  of  the  particular  definition  of  stability. 
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VARIANCES  OF  QUADRATURE  COMPONENTS 
OF  CROSS-SPECTRUM  ESTIMATE 


The  zero-mean  complex  *V  \ (f)  in  (6)  is  the  random  error  in 
estimation  of  the  cross-spectrum.  The  diagram  in  Fig.  1 depicts  the 


Fig.  1.  Complex  Random  Variables  in 
Cross-Spectrum  Estimation 


relationships  between  the  various  complex  "RVs  . Here 

(13) 

is  the  true  phase  of  the  cross- spectrum. 

It  is  convenient  to  represent  complex  “RV  (f^  in  terms  of  its 
real  and  imaginary  components, 

^ (14) 

as  shown  in  Fig.  2.  Also  depicted  are  the  projections  of  3(f)  on  a 


Fig.  2.  Projections  of  Random  Error  Q(f) 
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different  rectangular  coordinate  systen  (£(f),b(f))  aligned  with  the 
direction  of  the  true  phase  1^(f)  of  the  cross- spectrum.  That  is,  we 
also  represent 

p «,[-;?,/)]  * (15) 

where  a(f)  and  b(f)  are  real.  We  note  immediately  that  all  the  "RVs  in 
(14)  and  (15)  have  zero  mean;  this  follows  from  the  definition  (6) . 

In  order  to  evaluate  the  covariances  of  these  various  quadrature 
components,  we  first  note  from  (7),  (12),  and  the  fact  that  4>wfo)  has 
been  assumed  unity,  that 

= 2<r„(f)Gs3W/K,  (16A) 

Et  f(f']  = 2 (16B) 

Equation  (16A)  (or  (7A))  affords  the  interesting  interpretation  that  the 
average  squared- length  of  the  random  error  q(f)  in  the  estimate  of  the 
cross- spectrum  Is,  in  fact,  independent  of  the  true  cross- spectrum,  but 
depends  on  the  auto- spectra  of  the  two  processes  involved.  (See  also 
(A15)  more  generally.) 

(14)  in  (16),  there  immediately  follows 

= t /K 

= [ ft,.  If-)  ftjjlf)  + te‘ISfr'3  * t*  /k 

= ± T?e{Y,’s  (17A* 


Substituting 

E(  r»<) 

1 H 


--  6„(f)G;f,(f)lM{^(f)}/K.  (17B) 

The  quantities  in  (17)  are  the  covariances  of  the  real  and  imaginary  parts 
of  the  cross- spectrum  estimate;  that  is,  using  (6)  and  (14), 

V«r  |>  1 = E { ^ (f)}; 

Coy  7s5y(ffj  ^ 
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Equations  (17)  and  (18)  are  basically  identical  to  Ref.  4,  p.  378; 
however,  the  scale  factor  K is  different. 

The  projections  a(f)  and  £>(f)  have  simpler  properties  than^(f)  and 
^(f).  From  (13),  (16),  and  (13),  there  follows 

e(  - l>B(n  ± I ffqtnH  /k- 

Ef&(PUi]  ' 0.  (19) 

Thus  the  projections  of  the  random  error  along  and  perpendicular  to  the 
direction  of  the  true  phase  of  the  cross- spectrum  are  uncorrelated. 
Furthermore,  the  variance  of  the  projection  a(f)  along  the  direction  of 
the  true  phase  is  always  greater  than  or  equal  to  the  variance  of  the 
projection  £(f)  perpendicular  to  the  true  phase.  In  fact,  if  the  magnitude- 
squared  coherence  is  unity  at  some  frequency  f,  , then  the  variance  of  b(f,  ) 
is  zero;  in  this  case,  all  random  fluctuations  of  £ (f,  ) lie  along  the 
line  with  phase  P^  ( f,)  in  Fig.  1.  ^ 

On  the  other  hand,  if  the  magnitude- squared  coherence  is  zero  at  some 
frequency  f 2 , then  the  variances  of  a(ft)  and  b(f, ) are  equal;  in  this 
case,  the  "scatter"  of  random  perturbations  g(f2)  in  Fig.  1 is  a circle 
centered  at  the  origin. 

Generally,  the  scatter  of  random  perturbations  is  like  an  ellipse, 
as  depicted  in  Fig.  3,  where  the  major  axis  of  the  ellipse  lies  on  the  line 


with  phase  ^(f).  If  TVs  a(f)  and  'b(f)  are  Gaussian,  as  they  would  be 
(approximately)  if  K is  large,  then  the  elliptical  diagram  can  be  made 
quantitative  and  interpreted  as  contours  of  iso-probability. 
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VARIANCES  OF  AMPLITUDE  AND  PHASE  ESTIMATES 

Estimates  of  the  amplitude  and  phase  of  the  cross- spectrum  are 
available  according  to 

(20) 

In  order  to  estimate  the  means  and  variances  of  A*,j(f)  and  ^(f),  we 
will  assume  that  the  scatter  of  points  in  Fig.  3 is  small  in  comparison 
with  the  distance  out  to  the  center  of  the  ellipse.  That  is,  using  (9) 
and  (10),  we  will  assume  that 

MfK»l-  (a) 

* 

This  requires  that  the  product  of  observation  time  and  desired  frequency 
resolution  be  much  larger  than  unity  (Ref.  1),  but  it  also  requires  that 


the  magnitude-squared  coherence  not  be  too  sme.ll  at  the 
interest. 

frequency  of 

We  first  utilize  (20),  (6),  and  (15)  to  express 

£^(f)  * jj  + a W + i Mf)l  «*r  [j  . 

(22) 

Then 

Ax3  (f)  = i 1g^|  + &(0  + «U>| 

(23A) 

= 1 

(23B) 

^ ~ P*y  If)  + **3^1  + ^ ® 

(24A) 

r V If)  4.  - %i£t.  . 

(243) 

Equations  (23A)  and  (24A)  are  actually  exact,  whereas  (23B)  and  (24B) 
require  the  assumption  of  (21).  Combining  (23B),  (24B),  and  (19),  there 
follows  immediately 

V«r * [e„tt)eB(f)+|Cq»r]/K 

(25A) 

\i  5 p fjL)i 

Vo^P^}-  ^p,.K  • 

(25B) 

= o. 

(25C) 
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Thus  the  amplitude  and  phase  estimates  are  uncorrelated.  The  variance 
of  the  phase  estimate  in  (253)  is  much  smaller  than  unity,  when  wo  recall 
that  assumption  (21)  is  necessary  for  (25)  to  be  true;  that  is,  the  denom- 
inator of  (25B)  must  always  be  large.  It  should  also  he  noticed  that  none 
of  the  covariances  in  eq,s.  (19)  or  (25)  depend  on  the  actual  phase  of  the 
cross- spectrum,  but  only  on  its  magnitude.  Some  additional  relations  on 
the  covariances  of  estimates  of  coherence  are  given  in  Ref.  4,  pp.  378-9; 
of  course,  the  phase  estimates  of  complex  coherence  and  cross-spectrum  are 
identical. 

EFFECT  OF  CLOSELY-  SPACED  TONES 

All  the  earlier  results  have  presumed  that  the  bandwidth  "B  of  the 
spectral  window  is  narrower  than  the  finest  detail  in  the  spectra 

(r»f(f),  £r<^(f)>  and  6-^( f) . We  now  consider  a case  where  this  is  not  so, 
and  investigate  the  variance  of  the  cross- spectrum  estimate. 


Suppose  the  spectra  are  approximately  pure  tones: 

GM!P**P,[lKW(K)].  (26) 

Then  from  (A27)  in  the  appendix, 


E 1 ]V(Kt  IVMtf 


sjw  5) 


(27) 


which  can  be  interpreted  as  the  variance  of  the  complex  RV  £*,(  **) . Now 
if  < B , and  if  the  frequency  f of  interest  lies  near  or  between  f*  and 

fij,  then  the  window  functions  in  (27)  are  near  their  peak  value  W(o)  . Also, 
^ (2PS)  — (2T)  , then  the  bracketed  term  in  (27)  is  near  unity. 
Then  the  variance  in  the  cross- spectrum  estimate  is  large;  in  fact,  it  has 
the  same  value  as  for  "P  =?  I , no  averaging.  Yet  the  true  cross-spectrum  may 
in  fact  be  zero.  Thus  estimation  of  the  cross- spectrum  will  oe  in  error, 
even  for  a large  TB  product,  in  a frequency  range  near  f„  and  fa . It  should 
be  noted  that  this  noisy  estimation  case  requires  the  frequency  separation 
of  the  tones  to  be  less  than  (2T) not  \2L) thus  the  tone  separation  must 
be  much  closer  than  the  fundamental  resolution  of  B^L*'. 


If  the  tone  separation,  on  the  other  hand,  satisfies  |f*-f,l  > (PS)*'  = T*', 
then  the  variance  of  estimation  is  greatly  reduced,  as  inspection  of  the 
bracketed  terra  in  (27)  indicates.  In  fact,  (27)  becomes 

E[lf(fil}  < i ?,TS Ihrlf.-f,) 5)  ’ if  (28) 

which  has  the  desirable  T 2 dependence  on  the  number  of  pieces  in  the 
average  (2).  Of  course,  when  ]fx-f4|>3,  then  the  window  functions  in  (27) 
decay  rapidly  and  indicate  a greatly  reduced  variance,  even  if  3 is  greater 
than  the  finest  detail  in  the  spectra. 
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APPENDIX  A.  DERIVATION  OF  MOMENTS 

From  (2), 

(ad 

But  from  (3), 

E [x*(f)  Y*  (pSJ  = If  <Hr,  i-ti  c.*  p (-1  w ft,- +4  WK  (fc)  “R  ,5  (E_+*) ) ^ A2^ 

where 


x E{xfr)-j’(t-4  (A3) 

is  the  cross- correlation  of  x(t)  and  y(t) . We  are  allowing  all  processes 
and  windows  to  te  complex,  for  generality,  and  have  utilized  joint- station- 
arity  in  (A3).  The  cross- spectrum  of  x(t)  and  y(t)  is 

£*3^)  - 3rrf  E).  (^4) 

Utilizing  (A4)  and  (5)  in  (A2),  there  follows  for  (Al), 

(A5) 

(A6) 

which  follows  from  (l).  Equation  (A5)  is  the  fundamental  relatxon  for 
the  mean  of  the  cross-spectral  estimate.  However,  when  is  less  than 
the  finest  detail  in 

= exj*-),  (a?) 

upon  setting  without  loss  of  generality. 


= l if  6,^|W(f-r)r; 

we  have  also  employed  the  fact  that 


To  evaluate  the  variance  of  £x,(f),  the  following  steps  are  required; 

from  (2),  1 

v 


e[1  6^  - X . (AS) 

But  the  statistical  average  in  (A8)  is,  using  (3), 

E{vKul  = S5J[ **p[-t  2-r-f  (fr  V £)W* 

• E{y^^x*^(f4.  (A9) 
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Further,  the  statistical  average  in  (A9)  is  given  by 

^ x*j ft, -40^  [L-ty  4- 

where  we  have  assumed  that  x(t)  and  y(t)  are  joint  Gaussian,  and  have 
defined  r *,  -\ 


( A10) 


(R^ tr) - 


(All) 


(The  last  function  in  (All)  is  generally  different  from  (A3).)  Denoting 
the  Fourier  transforms  of  the  three  functions  in  (All)  by  frw(f),  (f) , 
J&Xy(f)  respectively,  in  a manner  similar  to  (A4),  (A10)  becomes 

E-L’iy*]  ~ j c *p0  ^"7* ly) 

+-  e*f[i  2^4 

(f)  and  G^(f)  must  always  be  real.)  Substituting  (A12)  in  (A9),  there 
follows 

**?[-', 2wf (t,-V  fe)** 

* (V)  «*f[  i 2rry  ff 40 - J >TV  -£»')] 

+ £»  ty*)  jj  (t  -t,)  - » 2-rrV  (ij.-iOl 

+ -AxvjW  W [j  'brf  (4-,-t,)  - I (V+O]^ 


-[Ur  &;wxNKff-r>C  MK  M 

+ ^ w*  vuf-*) 

+ W*l!*J<fF-»)KN] 
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- ridM  [g^  $ iwfr-p^i1 

+ 6*,  M 6fjjy  (>’)  } W (f  - ;•  -'  | I Vl(f  - ?)|  2-rrS()f~  >«)  (y  - pj] 

+ WWi  If  - J*)  W*  (f  + >>)  W {^y)W*  [t-  *)  hrS {*-*) (j* + *)) "] 


fd^  SVj  (pjW;f'/<)l 


+ Jty  Grn  (p>|N  (f  - txp[i  M*— )^s]  J dv>  (p) ! W If  - »)|  e>j>£-  i 7n-  (k— «>  v 5^ 

+ [dj» (v)  W *(f  - v>)  W*  ft  + v)  e*y [i  “K  ( k-  »)  v Sj , (A1  3) 


Upon  substitution  of*  (A13)  in  (A 8),  ve  obtain 


+ 


£ Jl  G„  >,(*-->  s]  ■ V S^M;  < 7[-iv(v-.)pS] 

+ f ir  Jb^  Ifi'w  (f  ?)w  If*?)  "rfr  >(<-^1 J”  X,  ['’VMn*  M '4: 


= j e| (A14) 

where  ue  have  used  (O  . If  the  frequency  f of  interest  is  greater  than  the 
bandwidth  B of  the  window  then  W(f-jO  and  V(f+/0  do  not  overlap  on 

the  y-scale.  Then 

• [dp  Vj ff- - *0|* *3tP [7* ^ ^K_ 

. ^(v)|W5F^)]a^(r-^s).  (A15) 

This  is  a general  relation  for  EllffOft  ; it  will  be  noticed  to  be  independent 
of  cross- spec truin  6r^(f),  and  depend  only  on  auto-spectra  £r„(f)  and  G-^ f) . 
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Also,  there  is  no  need  to  knoy  f)  • 

If  B is  less  than  the  narrowest,  detail  in  £y»(f)  ana  £jj(f)  near  the 
frequency  f of  interest,  the  integral  on  ^ in  (A15)  becomes  approximately 

£„(«  tvP(i2«"lc5)  C(vs),  <A16> 

and  ( A1 5)  yields 

s ui7) 

Since  £ (f)  is  a complex  RV,  it  is  necessary  also  to  evaluate  the 
quantity  , in  addition  to  (A3),  in  order  to  complete  the  second- 

order  moments.  J Due  to  the  similarity  tc  the  derivations  above,  the  steps 
will ‘be  presented  in  a more  cursory  fashion. 

f?  = 4 k.  . (a>») 

1 3 J r Vc;w- 1 

” CjT[  dt,  (f  -d*  4 (Q 

<A19> 

tfc«}  + 4 IV*’) 

* \ I*  exj£i  V^I  (f,A)|  fy')  ex  p[i  >r V i^j  Qgy  M 

4 evp  [j yny  ^rtiU^wf  fp) *f&  ^ C^) 

4 e*  p [i  'lny (v  ,4^]  e*j>  [i  >>  (vjj  _ ( 4 -0 ) 

EkJ  - ify 

4X  (rUJMK  M K M 

4 


= JT ty  «fv  If)  W[>i(f  ->>)|  | wM 

4 ^Vj  (j*)  £yj(v)Vj  !£-f)VJ*  MWT^W  il  €>p  [i  ly-5[b-  *")  fpAf] 
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4 &„ WVI  (f -fWh,)  n,[i  y,  V-)/-5!  f <4.^  !»)W*M W’fM »)  !k->  s] 

+ -;Ay»  ^pLi in (k-^V5l  ^ ^r*,)!w?f-p)la<»xf[-i‘>i»- Mp5]. 

4 pi  |Jfy  2/n  !m)V<  cf  -^W  [f  ?>f{i  l* fc—fy Sj } W*  (•f-?)V/V  (f e ^-i  Ihr(K~»0 y sj 

» 

"l^vKT  + E^M')-- 


(A21) 


(A22) 


If  f is  greater  thar.  B , 

P.  „ 


E (f ^ - ^p»  j S*to! *>?[  i (*■--* VS> 

• V -v^\  U-rdf-w^s] 

I'C'T'  ~ /U\’u  . 'r  \V*  ' ->  ^ 

•p  *»*  '»*V>;  *->*>)  <?»f> 

• '■»#  s^*',\v'i-^l,«vr(-;2-.ws). 


= 1 % 

P 

This 

ger. 

;rai 

relation 

and  i 

not  on  t 

he  auto- s] 

know 

A,(f) 

or  Jftjj(f) 

If 

B 

is  less  ti 

(A23) 


to 


!x„3^/exp(i 2^rFkS^  4>*(V:S), 

and  ( A2 3 ) yields 


(A24) 


(A25) 
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For  the  ..•ase  where  x 
text),  the  genera I reiat: 
first  the  integral  y In 


) and  t)  contain  pure  tones  (eq.  (26)  of  main 
; A.1  c.'  for  takes  on  the  following  form: 

r)  -s  approximately 


"2  ?x  ! 'ii  ‘.f  • - f» ) | «"P'q  ’<  r„  S). 


(A26) 


Then  ( A1 5)  becomes  . 

E[  ! 5MrPft  - i ! W 'vt  -tV^r  iV>»' CF -f,y!2  f 0' 

_ j v v ’vjU  r\'i2  C£|^CEr.fc-&S^ — I 

using  Ref.  5,  (41 S)  and  (i2S) j this  relation  is  used  in  (27). 


(A27) 
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